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Abstract 

Background: As fiscal constraints dominate health policy discussions across Canada and globally, priority-setting 
exercises are becoming more common to guide the difficult choices that must be made. In this context, it 
becomes highly desirable to have accurate estimates of the value of specific health care interventions. 
Economic evaluation is a well-accepted method to estimate the value of health care interventions. However, 
economic evaluation has significant limitations, which have lead to an increase in the use of Multi-Criteria Decision 
Analysis (MCDA). One key concern with MCDA is the availability of the information necessary for implementation. In 
the Fall 201 1, the Canadian Physiotherapy Association embarked on a project aimed at providing a valuation of 
physiotherapy services that is both evidence-based and relevant to resource allocation decisions. The framework 
selected for this project was MCDA. We report on how we addressed the challenge of obtaining some of the 
information necessary for MCDA implementation. 

Methods: MCDA criteria were selected and areas of physiotherapy practices were identified. The building up of the 
necessary information base was a three step process. First, there was a literature review for each practice area, on 
each criterion. The next step was to conduct interviews with experts in each of the practice areas to critique the 
results of the literature review and to fill in gaps where there was no or insufficient literature. Finally, the results of 
the individual interviews were validated by a national committee to ensure consistency across all practice areas and 
that a national level perspective is applied. 

Results: Despite a lack of research evidence on many of the considerations relevant to the estimation of the value 
of physiotherapy services (the criteria), sufficient information was obtained to facilitate MCDA implementation at 
the local level. 

Conclusions: The results of this research project serve two purposes: 1) a method to obtain information necessary 
to implement MCDA is described, and 2) the results in terms of information on the benefits provided by each of 
the twelve areas of physiotherapy practice can be used by decision-makers as a starting point in the 
implementation of MCDA at the local level. 
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Background 

As fiscal constraints dominate health policy and planning 
discussions both across Canada and globally, priority- 
setting exercises are becoming more common to guide the 
difficult choices that must be made [1]. In this context, it 
is not only appropriate but also highly desirable to assess 
the value of specific health care services, as an assessment 
of value is necessary for priority setting on resource alloca- 
tion either through the use of a threshold (minimum value 
per dollar spent) or through a formalized priority-setting 
process such as Program Budgeting and Marginal Analysis 
(PBMA). 

A common approach to the assessment of the value of 
health care services is economic evaluation [2]. Economic 
evaluation is typically used in a threshold approach to re- 
source allocation, meaning that interventions costing less 
than a threshold cost per unit of benefit are deemed 
worthy of funding. However, there are well-known chal- 
lenges to the acceptability of economic evaluation as a tool 
to guide resource allocation decisions. A key such chal- 
lenge is to "ensure alignment between the objectives as- 
sumed in economic analyses and the objectives facing 
decision-makers in reality" [3]. Specifically, economic 
evaluation as a priority setting tool assumes that the 
decision-makers objective is to maximize health gain [4] 
but we know that other objectives are also typically pur- 
sued [4,5]. One solution offered is that "the simple C/E ra- 
tio could be supplemented by information on other health 
effects for the patient, for example a descriptive account 
of expected improvements in quality of life; wider societal 
effects of the intervention, for example on the number of 
jobs created; and nonmonetary costs for the patient 
reported in natural units such as waiting time in days" [4]. 
Such a solution can in fact be formalized through the use 
of Multi-Criteria Decision Analysis (MCDA): "MCDA is 
aimed at supporting decision makers faced with evaluating 
alternatives, taking into account multiple, and often con- 
flictive (sic), criteria" [6]. The criteria in MCDA are the 
other health effects! the wider societal effects' and the 
nonmonetary costs' referred to above, or put simply, the 
considerations that a decision-maker will typically take 
into account in making a decision on resource allocation. 
MCDA is typically used in formal priority setting pro- 
cesses such as Program Budgeting and Marginal Analysis 
(PBMA). Like economic evaluation, MCDA has methodo- 
logical challenges, but in many contexts, because it for- 
mally includes most or all considerations relevant to 
decision-making, this approach, and the associated prior- 
ity setting frameworks, fit the decision-maker s perspective 
better [7,8]. One key methodological challenge of MCDA 
is the search for the necessary information. The necessary 
information is often not readily available for two main rea- 
sons. First, some of the criteria, while relevant to decision- 
makers, are typically not common research subjects. This 



would include criteria such as integration or access. Sec- 
ond, even when literature is available, the information 
must be contextualized before it can be used. This paper 
reports on an example of how this key challenge can be 
addressed. 

In the Fall 2011, the Canadian Physiotherapy Associ- 
ation (CPA) embarked on a project aimed at providing a 
valuation of physiotherapy services that is both evidence- 
based and relevant to resource allocation decisions in 
health care organizations. This project originated more 
than one year earlier, in 2010, when the CPA Branch Presi- 
dents concluded that there was a need for more informa- 
tion on the value of physiotherapy services and asked the 
CPA national staff to consider developing a document that 
would address this need. After investigating the methodo- 
logical alternatives, the CPA national staff decided to 
proceed with the MCDA framework. 

In this paper we report on the methods used to obtain 
information necessary for MCDA implementation and 
provide a brief summary of the information that was 
produced. The objective is to show how a key challenge 
to the implementation of MCDA can be addressed and 
give a sample of the results. The full results which are in 
the final report are the starting point for an MCDA im- 
plementation. Actual examples of full implementation of 
MCDA within a priority setting process at the local level, 
building on the information produced in this project, are 
not included. 



Methods 

MCDA involves the assessment of alternative actions on 
the basis of a common set of criteria [9,10]. The two key 
elements of the MCDA process are the alternatives to be 
considered and the criteria to be used. Possible alterna- 
tives are those options available to the decision- maker, 
for example changing the level of funding for a given 
physiotherapy service or program. The criteria represent 
the relevant considerations in assessing the impact of 
implementing any of the different alternatives. Criteria 
therefore depend on the decision-making context. Once 
possible alternatives have been evaluated on the basis of 
the selected criteria, they can be compared and recom- 
mendations can be formulated. The evaluation of each 
alternative provides an assessment of what would be 
lost, in cases of a reduction in funding, and what would 
be gained, in case on increases in funding. When con- 
textualized, this valuation represents the marginal value 
of a service at the local level (as opposed to the total or 
average value) as the question that was posed with re- 
spect to each criterion was: what would be the impact 
on this criterion of an increase or a decrease to the 
current volume of service. The basic steps in MCDA are 
outlined in Table 1. 
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Table 1 MCDA steps 

1 The first step is the development of relevant criteria. The criteria should be clearly defined and must relate to the overall purpose of the decision 
process. The objective in the development of criteria is to include all considerations relevant to the decision that has to be made and to provide 
sufficient clarity to ensure consistency in the translation of information about the alternatives into ratings. 

2 The second step is the identification of the possible alternatives. In this case, the alternatives are the most common physiotherapy services. Each 
alternative [or in this case set of services] must be accompanied by the information required to assess it on the basis of the established criteria. 

3 The third step is the formal evaluation of each possible alternative. This is done by rating each alternative on each criterion and calculating a 
composite score. Because the same criteria are used with all alternatives, the scores are comparable across all alternatives. 

4 The final step is the formulation of recommendations. First, each composite score is validated to ensure that no process errors took place. Once 
that is done, each alternative can be ranked in relation to all others. Funding recommendations are then based on this ranking. 



The first step in the application of MCDA to the valu- 
ation of physiotherapy services was to determine a set of 
criteria relevant to decision making on health care re- 
source allocation involving such services. The perspec- 
tive adopted for this project was that of a decision 
maker within a health region or health service delivery 
organization, as this was the primary target audience for 
this work. Based on previous priority setting work with 
Canadian health authorities and on the literature on pri- 
ority setting [11-14] an initial set of criteria was pro- 
posed to the CPA and, through discussion, a final list of 
eleven criteria was developed (see Table 2). The criteria 



were defined in such a way as to ensure that overlap was 
minimized [i.e., they are meant to be mutually exclusive, 
as much as possible]. 

Moving to step two, the CPA identified a set of service 
areas for assessment, based on relevant literature and 
similar briefings on value for money developed in the 
United Kingdom by the Chartered Society of Physiother- 
apy. The final list contained twelve service areas (see 
Table 3). 

This research project was about the second part of 
step two which is to obtain information necessary to as- 
sess each alternative on the basis of each criterion. This 



Table 2 Criteria and definitions 



Resource impact 
Quality of Life 

Patient/ provider satisfaction 



Integration 

Access 

Equity 

Effectiveness 
Appropriateness 



Acceptability 

Implementation challenges 



Impact on future use of health care 
services [3+years] 



Impact on system-wide resource use 

This criterion deals with the absolute change in quality of life, i.e. a service that has a limited impact on 
quality of life could not rate to the top of the scale on this criterion. 

Deals with benefits of the service other than the direct impact on the underlying condition, for example, a 
service that is very personalized will rate higher here because, presumably, the provider would be able to 
allow to a greater extent for the client's preferences [for example, regarding the nature of the activities, the 
location, the timing, the setting- group or alone]. 

This criterion is about the continuum of care [and goes beyond the health care system]. Does the service 
address a gap in the continuum of care that facilitates the clients' transition from one program or service to 
another? 

This criterion measures the impact of the provision of a given service on the current utilization of other 
services, thereby possibly making these other services more accessible. For example, if a given service results 
in fewer hours per week of home care being required, then this service has freed up those hours for 
someone else to use. Some services will free up resources that way and some won't. 

Impact of the service on the health status of groups where there is an avoidable, unfair, and remediable 
health status gap. 

This is about the absolute effectiveness of the service. Just because a service is the best that can be done 
for an underlying condition does not mean that it is highly effective. Also effectiveness is measured with 
respect to the impact on the underlying condition itself or the impact on the consequences of the 
underlying condition. 

This criterion deals with the high level degree of match between a given service and the overall needs of 
the population, defined as the combination of the number of persons with the underlying condition and 
the impact of the underlying condition on quality of life. We should also consider here the availability of 
possible alternatives. Alternatives to be considered here can be privately provided services but also different 
services that are publicly funded. We are getting at the idea of the possibility of substitution with this 
criterion. 

This deals with the relative 'displeasure' associated with the service delivery- amount of pain, discomfort 

Risks associated with the implementation of given service change [for example, increased volume] but also 
degree of support- this would be measured, amongst other considerations, by the extent of public pressure 
in favour of a service. 

This criterion is about the extent to which the provision of a physiotherapy service now is likely to affect the 
overall use of health care services down the road [at least three years from now]. 
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Table 3 Selected service areas for review 



1. Physiotherapy interventions for musculoskeletal conditions 

2. Physiotherapy interventions for low back pain 

3. Rehabilitation services in the intensive care unit 

4. Physiotherapy interventions for chronic disease management 

5. Rehabilitation services for chronic lung disease 

6. Rehabilitation services for cardiovascular disease 

7. Rehabilitation services following joint arthroplasty 

8. Rehabilitation services following stroke 

9. Physiotherapy services in the emergency department 

10. Home based rehabilitation services 

1 1 . Rehabilitation services for falls 

12. Rehabilitation services for pediatrics 



was done in a three part process. First, a literature re- 
view was undertaken to identify peer reviewed papers 
that address the notion of value (as defined by the cri- 
teria). Search terms included the given service area along 
with effectiveness; cost-effectiveness; Value' and a myr- 
iad of other terms relating to the identified criteria. Due 
to the breadth of the search, a systematic review was not 
attempted; rather key papers were identified and 
reviewed with the intent of providing insight into a given 
service area, as opposed to a comprehensive take on 
each area. Not surprisingly, for many of the criteria there 
was no, or very limited, research evidence. The second 
part of the search for information or evidence was a 
series of interviews with content experts for each of the 
twelve service areas. These content experts (n=l to 3 de- 
pending on the service area) were identified by the CPA. 
Through one or more phone consultations, the literature 
review for each service area was critiqued and new infor- 
mation was generated where no, or insufficient, litera- 
ture existed. This was an important part of the process 
as the literature only provided information on some of 
the criteria. The missing, but required, pieces of infor- 
mation thus came from expert opinion. It is in this com- 
bining of expert opinion with research finding that 
MCDA provides a pragmatic approach to valuation. 

After drafting of an initial synthesis document by service 
area which combined the results of the literature review 
with expert opinion, there remained a need to ensure that 
1) the information presented would be applicable at a na- 
tional level (as opposed to the provincial or regional level) 
and 2) the assessments would be consistent across the ser- 
vice areas (noting that the content experts were only fo- 
cusing on a single service area). For this purpose, in the 
third part of the process to acquire the required informa- 
tion, the CPA struck a validation committee comprised of 
eleven individuals from across Canada with a broad range 
of experience in physiotherapy. Over the course of 2 two- 



hour meetings, the synthesis document was reviewed in 
detail. In some cases the validation committee requested 
additional information from the literature and clarification 
of points made by the content experts. The synthesis 
document was then adjusted to reflect the comments from 
the validation committee, including additional research in- 
formation and clarification of expert opinions, resulting in 
the final synthesis by service area. Steps three and four of 
the MCDA process were not included in this project as 
those steps are context-dependant by nature. 

Results: Key findings by service areas 

In this section, we present the some of the key findings 
by service area. This section is limited to select key find- 
ings because full presentation is beyond the scope of this 
paper: we have 11 criteria and 12 service areas which 
means 132 cells of information which in the final report 
represented 55 pages of content. Where findings are 
based on published evidence, references are provided. 
When there is no reference, the findings are expert opin- 
ion, obtained as described above. Further details, including 
the key findings for each criteria, for each of the twelve 
service areas are presented in Table 4 (there again, where 
findings are from the literature, references are cited). 
Complete results can be found in the CPA report 'Valuing 
Physiotherapy Services' [15]. The findings presented here 
represent the minimum starting point required to imple- 
ment MCDA at a local level. In the Discussion, we de- 
scribe how these results can be used in an MCDA exercise 
in a health service organization. 

Pediatrics 

The cost of providing pediatric physiotherapy services 
tends to be higher than treatment for adults, however the 
long-term benefits and decreased burden on future use of 
care services can be significant. Besides the expected dir- 
ect impact, for example, the direct impact on children 
with juvenile idiopathic arthritis [30], with cerebral palsy 
[31], or with cystic fibrosis [32], there are two important 
benefits of pediatric physiotherapy that emerged: 1) the 
physiotherapist typically develops a supportive relationship 
with both the child and his or her family. In this role, the 
therapist is an essential source of information and educa- 
tion making the physiotherapist a valued link to, and guide 
through, an often-times overwhelming care process for 
children and their parents; and 2) pediatric physiotherapy 
services play an important role in the transition to adult- 
hood. Therapists can act as a bridge between programs to 
ensure the continuation of treatment while transitioning 
from child to adult care. 

Home-based services 

Home-based physiotherapy services are highly effective 
for many health conditions, including frailty in elderly 



Table 4 Key findings by criteria service areas 



Resource Quality of life Patient/ Integration Access Equity Effectiveness Appropriateness Acceptability Implementation Impact on 

impact provider challenges future use of 

satisfaction health care 



1. Physiotherapy 
interventions for 
musculoskeletal 
conditions 



2. Physiotherapy 
interventions for 
low back pain 
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of adding 
rehabilitation to 
standard care 
was a savings of 
$152 per patient 



Table 4 Key findings by criteria service areas (Continued) 



6. Rehabilitation 
services for 
cardiovascular 
disease 



Outpatient CR 
less expensive 
than inpatient 
yet similar 
effectiveness 



CR significantly 
improved QoL 
scores, reduced 
depression and 
had positive 
effect on 
psychosocial 
measures 



Service can be 
fully tailored to 
the client's 
situation 



Clients come 
from diagnosis 
of cardiovascular 
condition then 
transition to 
local, ongoing, 
community 
services; CR 
plays an 
essential role in 
facilitating this 



Impact on the 
use of other 
health services 
is not 
immediate 
(except for 
length of 
hospital stay) 



Women, the 
elderly, ethnic 
minority groups 
access CR less. 
Very little 
information on 
why subgroups 
have lower rates 
of access 



CR reduces the There is a 



risk of cardiac 
and general 
mortality rates 
by 25-30% 



growing referral 
rate AND a 
growing uptake 
rate because of 
increased 
awareness 
(referral rate) and 
improvements in 
services (uptake 
rate) 



The services 
are mostly 
about teaching 
so there is no 
physical pain. 
Changes in 
lifestyle being 
promoted can 
be difficult to 
adopt 



None noted 



Services reduce 
the likelihood of 
recurrence of the 
problems and 
reduces the 
seriousness of 
future problems 



7. Rehabilitation 
services 
following joint 
arthroplasty 



When comparing 
the cost- 
effectiveness of 
an accelerated 
perioperative care 
and rehabilitation 
protocol with 
that of a more 
standard protocol 
for patients 
treated with total 
hip arthroplasty, 
beginning from 
the first visit 
before the 
operation to one 
year 

postoperatively, a 
study found the 
accelerated 
intervention to 
be more effective 
with an average 
of $4000 
reduction in 
treatment costs 
with a 0.08 QALY 
gain; also more 
cost-effective for 
total knee 
arthroplasty with 
no difference in 
QALYs [24] 



PT provides 
both earlier 
functionality and 
a better end 
point 



Postoperative, 
active physical 
therapy increases 
satisfaction and 
helps to meet 
patient 

expectations [25] 



Impact on 
continuum of 
care comes from 
accelerating 
patient's 
progression 
through the care 
process 



Will reduce 
doctor visits 



More difficult to 
access PT 
services in rural 
settings 



Using team 
approach, 
patients had 
large 

improvements in 
outcome 
measures during 
the 

rehabilitation 
stay and 6- 
month follow-up 
[26] 



Joint arthroplasty 
volume is driven 
by demographics 



High 

acceptability 



No significant HR 
or equipment 
challenges 



No evidence of 
impact on future 
use of health 
care services (3 
+years) 



Table 4 Key findings by criteria service areas (Continued) 



8. Rehabilitation 
services 

following stroke 



9. Physiotherapy 
services in the 
emergency 
department 



Very early 
mobilisation 
(VEM) more cost- 
effective than 
standard care 
and improved 
outcomes 



Research 
findings still 
lacking; recent 
innovations in 
diagnosis, 
management, 
and 

rehabilitation 
have resulted in 
measurable 
improvements 
in clinical and 
functional 
outcomes after 
acute stroke; 
however, 
despite 
improvements 
in medical 
management, 
quality of life is 
not necessarily 
improving post 
stroke [27] 



Programs are 
meant to be 
patient-centered: 
this is the goal; 
limitation is in 
resource 
constraints 
which reduces 
ability to 
customize 
treatment plans 



Key component 
of the continuum 
of care; If there is 
not sufficient 
physiotherapy 
services LOS is 
longer and/or the 
patient does not 
do as well 



Very limited 
impact on the 
concurrent 
utilization of 
other services 



Increased odds of 
problems from a 
past stroke 
associated with 
failure to access 
OT/PT services, 
lower monthly 
income, and age 



Comparing 
specialized 
outpatient 
therapy to no 
treatment, 14 
RCTs found that 
therapy-based 
outpatient rehab 
was associated 
with a reduction 
in the odds of 
poor outcome 
and increased 
daily living and 
personal activity 
scores 



Stroke is a 
significant 
condition in 
terms of 
incidence; 
physiotherapy is 
an integral part 
of its treatment 



Stroke causes 
fear in patients, 
which increases 
treatment 
acceptance rate; 
physiotherapy 
focuses on 
restoring 
physical function 
and in so doing, 
provides positive 
feedback 



Requires more 
rehab beds and/or 
specialized units 



Improved 
physical function 
and has direct 
impact on social 
function; 
minimizes the 
future use of 
health care 
services 



Can reduce LOS 


Services 


Potentially better 


Important 


Sizeable 


Rate of 


At system and 


There is an 


Sometimes 


Increased volume 


Patients are 


for some 


address fear 


client satisfaction: 


'triaging' role in 


impact on rate 


emergency visits 


provider levels, 


increase in ED 


'forces' the 


comes with a 


flagged earlier for 


patients; 


and uncertainty 


less pain, reduces 


the continuum 


of return visits 


not clearly 


there is limited 


attendances, 


realization that 


need for 


present and 


facilitates flow in 


around risks 


short-term 




to emergency 


related to being 


research 


therefore an 


the patient is at 


observation beds 


potential 


the ER 


when 


disability, 






part of any 


evidence on the 


increased need 


a time of life 


and sub-acute 


problems and 




discharged 


improves 






disadvantaged 


value of an 


for emergency PT 


where there is a 


beds 


can be followed/ 






function and 






populations 


emergency 


services 


loss of 




assisted in the 






safety 








department 
physiotherapy 
service; at patient 
level, there is 
high-level 
evidence of 
benefits in terms 
of improved pain 
control and 
reduced disability 
in the short term 




independence 
and a need for 
mobility aids or 
assistance 




community 



Table 4 Key findings by criteria service areas (Continued) 



10. Home based 

rehabilitation 

services 



Significant cost 
aversion; 
mobility 
assessment, 
keeping people 
independent in 
their homes; 
prevention of 
falls and 
providing a safe 
environment 
within the home 
context 



Impact of PT 

can include 

increased social 

interaction; 

improved 

personal and 

domestic 

activities; 

improved 

health status; 

improved 

subjective 

quality of life; 

reduced 

caregiver 

burden 



Patient 
satisfaction is 
clear (but 
typically is not 
tracked by formal 
instruments); one 
measure of 
satisfaction is that 
the clients pay 
for subsequent 
visits; verbal 
feedback from 
clients is very 
positive; while 
anecdotal, the 
high level of 
satisfaction is 
clear 



Service is 
extremely 
relevant to 
service 

integration; big 
gap in the 
continuum of 
care from 
hospital to 
home; a lot of 
people 

discharged from 
the hospital and 
in need of 
home-based 
service but are 
not receiving it 
or receive it in a 
very limited 
manner, i.e., no 
active rehab 
post discharge, 
rather patients 
are given a 
walker or basic 
level of 
information 



Reduces LOS 
and 

hospitalisations 



Inequities exist 
between 
Provinces: those 
without financial 
means do not 
have access to 
home-based 
rehab services in 
some Provinces; 
those with 
chronic 
conditions are 
more vulnerable 
and need more 
follow-up; 
currently, there is 
no support from 
the public system 
to help these 
individuals 



When comparing 
adults 70 years or 
older with one or 
more functional 
problems who 
received a home- 
based 

programme of 
occupational 
therapy and 
physiotherapy to 
a control group, 
a significant 
reduction in 
mortality rate 
was found (5.6% 
vs 1 3.2%); 
individuals with a 
moderate risk of 
mortality in the 
intervention 
groups also 
showed a 
significant 
reduction at 
16.7% vs. 28.3% 
[28] 



Home-based 
therapy increases 
access, in 
particular for 
patients with 
greater medical 
complexities 



Main issue is 
the payment 
required for 
services 



Have to have the 
right provider: not 
every 

physiotherapist 
can provide this 
service; broad 
experience base is 
required to be 
effective and 
proficient; 
therapist works on 
their own which 
means there are 
no second 
opinions; some 
anxiety in 
providing in- 
home services 
and worker safety 
can be a concern 



Home-based 
services are 
expensive with 
respect to time to 
travel and low 
volume however 
this needs to be 
considered in 
light of potential 
decrease in 
utilization of 
future service 
needs; in the 
long term, this is 
a very efficient 
use of societal 
resources 
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11. 

Rehabilitation 
services for falls 



Treatment for 


Specialized 


Falls prevention 


Not really part of 


Fall prevention 


Programs tend 


Exercise 


Need to get out 


No physical 
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Substantial 


falls was 1.8 


balance 
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a continuum of 
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to target seniors 


program 
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with health care 
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times more 


program for 


a new field, to 


care in most 
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significantly 
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professionals 
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date has not 
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prospective 


psychological 


generally 


cases where falls 


implementing a 


osteoporosis 


drawn adequate 




other services; 




of death, of 


services instead 


'discomfort' as 




can be avoided 


fall prevention 


significantly 


attention 




greatest 




falling and 


of providing 


fall prevention 






program 


improved 

quality of life, 

physical 

function, 

symptoms, 

social 

interaction and 
overall 

wellbeing [29] 






impact on 
future service 
use 




hospitalisation 
or transfer to a 
nursing home 


service 

retrospectively 


associated with 
a loss of 
independence 
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adults [33], ankle fractures [34], stroke [35], heart failure 
[36], breast cancer [37], and recovery from hip replace- 
ment surgery [38]. For such conditions, home based in- 
terventions have been shown to lower mortality rates 
related to falls [28,39] and the risk and rate of falls in 
older adults [40], reduce the number of nursing home 
admissions and hospitalisations, and decrease hospital 
length of stay. 

Home-based physiotherapy programs are critical to 
service integration, providing a much-needed link be- 
tween hospital and home. Home-based physiotherapy 
services can also help with a social issue: social isolation 
is often an issue for older clients and clients with more 
complex conditions; with physiotherapists providing in- 
home care, patients receive regular visits and consistent 
monitoring and follow-up. 

Intensive Care Units (ICUs) 

The most common use of physiotherapy in ICU is to 
improve function for patients on mechanical ventilation 
[41]. Improving function has been shown to reduce de- 
pendency and promote earlier weaning, which in turn 
decreases hospital length of stay and increases quality of 
life [42-44]. With a reduction in hospital length of stay, 
along with increased function and fewer patient compli- 
cations, physiotherapy treatment is highly cost-effective, 
reducing both the burden on acute care services and fu- 
ture health care service use [45,46]. Further, because 
treatment prevents critical weakness and increases func- 
tional ability [45,47,48] patients are less likely to be 
discharged to a care facility and are more likely to return 
to their home. 

Cardiovascular rehabilitation 

Cardiac rehabilitation services support patients when 
transitioning from hospital to the community by helping 
with linkages to services within the community. This 
helps to ensure that client care continues after discharge. 
Such linkages also help to promote social engagement, 
adoption of healthy behaviors and provide support for 
self-managed care. Along with a resulting reduction in 
hospitalisation rates [49] and improvements to physical 
activity, smoking cessation rates, systolic blood pressure, 
weight loss and total cholesterol [50,51], cardiovascular 
physiotherapy services also provide a means of enhan- 
cing the surveillance of higher risk patients while provid- 
ing personalized, tailored care that leads to improved 
psychosocial function. 

Emergency 

Physiotherapists in emergency departments can improve 
pain control [52] and reduce short-term disability [53]. 
Early access to physiotherapy for this purpose can im- 
pact current and future use of health care services. 



Physiotherapists also aid in discharge planning by pro- 
viding community program information and recommen- 
dations for mobility aids. Such assistance facilitates the 
continuation of care which in turn can alleviate patients' 
fear of the acute event reoccurring while supporting a 
safe return to the home and community. 

Emergency department physiotherapy programs can 
also decrease hospital length of stay and wait-times, in 
particular for minor musculoskeletal injuries [54]. Fur- 
ther since emergency departments are often a patients 
first point of care, clients who would benefit from 
physiotherapy interventions can be flagged early on in 
the care process directly impacting current and future 
use of health care services. 

Stroke 

Research shows that physiotherapy services for stroke 
patients aid in the prevention of subsequent acute events 
while supporting a patient s ability to live independently 
[55,56]. Physiotherapy services were also found to be a 
key component in the continuum of care, supporting pa- 
tients in their transition from hospital to home [35]. 
This is particularly true when treatment is provided early 
and through a specialized stroke unit [56-58], with a 
dose-dependent effect being present [51]. High intensity 
physiotherapy programs, task-specific therapies and indi- 
vidual discharge planning all contribute to improved 
outcomes. 

Outpatient physiotherapy programs for stroke patients 
are also effective. It was found that when outpatient re- 
habilitation programs were reduced, the length of stay in 
hospital increased along with rehospitalisation rates and 
overall costs [59,60]. 

Musculoskeletal conditions (MSK) 

With programs focusing on client self-management and 
independence, physiotherapy services are highly valued 
as an effective tool in the promotion of injury recovery 
and prevention of acute events [61]. Furthermore, there 
is a clear, positive relationship between increased phys- 
ical functioning and improved quality of life. 

While the initial costs of physiotherapists treating 
MSK patients are higher because of the requirement for 
experienced therapists, patients tend to require fewer 
visits over time. Care costs can be further reduced by 
using physiotherapists in triaging of patients: experi- 
enced physiotherapists can act as gatekeepers to surgical 
care, providing appropriate assessment and management 
of the patients condition [62-64]. 

Low back pain 

Physiotherapy for patients with low back pain is highly 
effective in reducing both acute and chronic pain while 
significantly limiting the risk of increased disability and 
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chronic conditions [65-67]. Research suggests that be- 
tween 80 to 90 percent of all lower back cases can be re- 
solved through participation in rehabilitation programs. 
Rehabilitation programs are also cost-effective [68-71]. 
Prompt access to a dedicated physiotherapist for new 
cases of low back pain, in particular for high-risk pa- 
tients, often pays for itself by reducing the burden on 
other health care services and promoting self-managed 
care. Brief, simple and early interventions that include 
providing information, reassurance and encouragement 
to engage in regular physical activity have resulted in 
economic gains measured one year after patients re- 
ceived the intervention, with no long-term negative ef- 
fects [71]. 

Physiotherapists can also assist in the triaging of pa- 
tients to ensure that only those requiring an MRI and a 
surgeon consult receive a referral for such. Acting as a 
gatekeeper to surgical care, physiotherapists are able to 
reduce patient treatment costs and significantly impact 
surgical wait-times. 

Joint arthroplasty 

Overall, effectiveness studies indicate that patients who 
underwent joint arthroplasty and participated in physio- 
therapy programs experienced improved outcomes [72] 
with the greatest health gains achieved from early inter- 
vention such as starting rehabilitation 24-hours post- 
surgery [73]. Benefits included a reduction in pain and 
an increase in joint motion range, strength and balance 
[73,74]; short-term functional milestones were also 
attained within a shorter timeframe [24,75]. Early inter- 
vention had a positive impact on the length of hospital 
stays resulting in programs that are highly cost-effective 
[24,76,77]. Overall, inclusion of physiotherapy services in 
the care continuum had a significant impact on treat- 
ment costs [78]. Discharging patients direct to home 
with supportive therapy was also found to be more cost- 
effective than remaining in hospital with no difference 
found in health outcomes. 

Chronic diseases 

There is strong support for the use of physiotherapy in 
the prevention and treatment of chronic diseases, in- 
cluding hypertension, emphysema, type II diabetes and 
obesity [79-84]. Studies have shown that patients who 
participated in individualized exercise programs had 
fewer emergency readmissions and physician visits and 
greater quality of life than patients in usual care. Physio- 
therapy programs also facilitate participation in commu- 
nity programs that enhance and maintain physical 
wellbeing, and this in turn can significantly impact 
future use of health care services. Physiotherapy is an in- 
tegral part of the inter-professional team in the manage- 
ment of patients with chronic diseases. 



Falls 

Physiotherapy is a highly effective tool in the prevention 
of falls and fall-related injuries both in hospital [85], as 
well as in the community [86-88]. In the community, 
the effectiveness of physiotherapy programs is significant 
with services improving the strength, motor function 
and balance in older adults who had previously experi- 
enced a fall event [89]. These effects contribute to re- 
duced mortality rates, rates of hospitalisation and 
transfers to a nursing home allowing individuals to live 
independently in their homes. Similarly, the implementa- 
tion of a falls -prevention program in an orthopaedic 
hospital can result in a significant decrease in fall inci- 
dence [85], fall-related morbidity and service costs. 

Quality of life measures indicate that participation in a 
falls-prevention program improves a patients confidence 
and reduces the fear of falling that often restricts overall 
physical activity [90]. 

Chronic lung disease 

There is strong evidence to support the effectiveness of 
pulmonary rehabilitation services for patients with 
chronic lung disease, with program participation corre- 
lated with decreased rates of dyspnea, exacerbations, 
and emergency room and physician visits [23,91,92]. 
Physiotherapy services were found to be cost-effective 
[93-98] and in some cases a programs net cost was 
negative (i.e. the program produced net savings): for pa- 
tients participating in outpatient pulmonary rehab pro- 
grams, evidence suggests that patient total health 
resource use is lower compared to usual care. Rehabilita- 
tion programs also decreased medication use, the num- 
ber of ICU admissions over time, and assisted patients 
in managing their condition, enabling them to remain in 
their homes longer [99]. 

Discussion 

In the context of choices that must be made because not 
all activities can be carried on as they were due to finan- 
cial restrictions, information about the value of any 
given intervention is very useful [100]. A common 
framework for generating such information is economic 
evaluation where the cost per Quality- Adjusted-Life- 
Year (QALY) gained through a given intervention is esti- 
mated. The estimated cost per QALY gained however 
only addresses the impact on the life expectancy and on 
the quality of life of the clients or patients. In making 
decisions about allocating limited funding, decision- 
makers typically consider other objectives in addition to 
the direct health impact, with equity and access, for ex- 
ample, being often cited [101]. Moreover, economic 
evaluation is focused on specific end-points which are 
typically directly related to the condition, or potential 
condition, being addressed, for example, the extent to 
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which physiotherapy services would impact a specific 
measurement of the progress of juvenile idiopathic arth- 
ritis. Because of these limitations, when the CPA decided 
to address what they felt was a gap in the available infor- 
mation on the value of physiotherapy services, it made 
the decision to address this gap through the application 
of MCDA. The overarching thinking behind this deci- 
sion was that, as healthcare organizations face increas- 
ingly tougher choices, the limitations of QALYs as a 
resource allocation tool will push organizations toward 
more formal resource allocation frameworks that use 
MCDA in their evaluation of alternatives and physio- 
therapy services will be more likely to receive fair con- 
sideration if the health care organizations have access to 
accurate information. PBMA would be one of these 
frameworks. The choice of MCDA was not primarily 
guided by the relative level of difficulty in implementing 
a QALY approach versus MCDA. There was what was 
perceived as a shortcoming in information on the value 
of physiotherapy services and it was decided to put effort 
in the MCDA approach provided a greater potential for 
impact. 

The result was a comprehensive report summarizing 
the value of each of twelve areas of physiotherapy ser- 
vices with respect to each of eleven criteria that were 
thought to represent all relevant considerations in mak- 
ing decisions about funding involving those services. 
Some key findings in terms of benefits of physiotherapy 
services are presented in this paper. It must be recog- 
nized that this paper is not reporting on an implementa- 
tion of MCDA, or of a prioritization exercise. In fact, 
what the CPA has done is supply health care organiza- 
tions in Canada and elsewhere with a base of research 
work necessary for the implementation of MCDA, as 
part of a resource allocation framework such as PBMA. 
The findings can be used as a starting point within any 
local MCDA implementation. It is not the role of the 
CPA to contextualize the information, assign weights to 
the criteria, or even suggest that only the criteria listed 
here should be used, or to actually rate the impact of 
service volume changes. These steps are the responsibil- 
ity of local health care organizations. An organization 
that decides to implement the MCDA framework to 
guide resource allocation would have to: 1) determine 
locally relevant criteria and weight them (these could be 
different than the criteria used in this study but it is not 
expected that there would be significant differences); 2) 
identify possible service volume change options that 
make sense in their context (which depends on the 
existing mix and volume of services provided); 3) assess 
the impact of each option on the basis of the selected cri- 
teria (this is where the information contained in the CPA 
report comes into play and provides a necessary starting 
point, i.e. necessary but not sufficient information). Note 



that the breakdown of areas of practice may not perfectly 
fit a given local context, in which case, the relevant areas 
from the twelve used here can be combined; and 4) rank 
the options and make decisions. All these steps are stand- 
ard practice in most prioritization framework, and are part 
of the PBMA, for example. 

Our objective here was not to provide one more case 
of PBMA implementation but to address a common 
criticism of PBMA or any other process that includes 
MCDA: that the required information is either not avail- 
able or too difficult to obtain making such processes 
unimplementable and therefore only theoretical con- 
structs. . In terms of information generation, the lite- 
rature review posed no unusual challenge. As was 
expected, in the grid of criteria by service area, many of 
the cells were left blank after the review. The recruit- 
ment of experts was done by the CPA and didn't seem 
very difficult for two reasons: this was a project of the 
CPA and many members are very supportive of their 
organization and it is a project that many members can 
relate to and specifically support. Furthermore, the de- 
mands are not overly burdensome as each expert was 
asked to participate in one or two calls of one to two 
hour each. What is more challenging is explaining to the 
experts what is needed from them which is to provide a 
response to the best of their knowledge and not limit 
their answers to what they know is research evidence- 
we really wanted their expert opinion. While this did not 
come naturally to some of the experts involved, all 
ended up contributing as was needed. Putting together a 
validation committee was no more challenging than 
recruiting experts for the same reasons. And just as was 
the case with the experts, it is necessary to have a full 
explanation of the process and some basic training in 
MCDA before the committee can start to work. The 
main challenge with validating the local data to the na- 
tional level was understanding how much of the expert 
opinions were shaped by unique local circumstances. 
This was addressed by first identifying where this might 
be the case, going back to the local expert for further in- 
formation, and then reconvening the validation commit- 
tee. The key lessons from this experience were: 1) there 
has to be experts that buy into what is being done, reluc- 
tant participation would defeat the process; 2) explan- 
ation of the process and its goals and basic training is 
necessary before the experts can be asked questions. 
Finally, it must always be remembered that the ultimate 
goal is to obtain the best existing information, some- 
times experts feel uncomfortable with expressing their 
opinion in response to a question but if it is the only 
available information then it becomes the best existing 
information. In our project, we found some initial hesi- 
tation in some cases but all experts were able to over- 
come it. The main limitation of this paper and the 



Dionne et al. Cost Effectiveness and Resource Allocation 201 3, 11:1 1 
http://www.resource-allocation.eom/content/1 1/1/1 1 



Page 14 of 16 



supporting report is the extent of the resources available 
for this project. For many criteria, the principal source 
of evidence was expert opinion and this was provided on 
a strictly voluntary basis. There was sufficient input into 
the process to produce validated results but, without a 
doubt, more resources would have produced a more re- 
fined report. However, a benefit of the MCDA approach 
is the transparent nature of the process which allows on- 
going updating of the results. As new studies are pub- 
lished or as more experts can devote time to this 
analysis, findings can be continually updated, by area of 
service or by criterion. And further areas of service can 
be added. 

Conclusion 

As the growth in public health care funding slows, more 
difficult choices about what to fund and what not to fund 
must be made. In this context, relevant and accurate infor- 
mation about the marginal value of any health care inter- 
ventions is essential for proper resource management. 
MCDA can be a very effective means of producing such 
valuations which can then be used in whatever priority 
setting process is implemented. However MCDA requires 
evidence on aspects of value where there is typically very 
little research evidence available. In this paper we have de- 
scribed an approach to addressing this challenge. The 
results presented are valuable for two reasons. First, a 
pragmatic approach to the generation of necessary evi- 
dence is presented. While this approach may seem rather 
obvious, the fact is MCDA and priority-setting processes 
that employ MCDA are often denigrated on the basis of 
the implied demands for information and the challenges 
that this poses. Second, this paper also provides a glimpse 
of the findings that were generated which may lead some 
readers to refer to the final report as a solid starting point 
for an application of MCDA involving any of the twelve 
areas of physiotherapy services studied. 
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